The Merits of Externally Invalid Survey Experiments

 

Gustavo Diaz
McMaster University
gustavodiaz.org

 

Slides and paper: talks.gustavodiaz.org

Limitations

“Future research should confirm if our findings generalize…”

  • …with a representative sample
  • …in other countries
  • …beyond the survey setting
  • …when using behavioral outcomes

Usual workflow

  1. Consider resource/ethical/practical limitations

  2. Conduct survey experiment with convenience sample

  3. Wave hands about external validity

Goal

  • Move beyond limitations approach

  • What makes an externally invalid experiment desirable on its own?

  • Challenge: Different kinds of external (in)validity

External validity concerns